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Abstract 

We give stationary estimates for the derivative of the expectation 
of a non-smooth function of bounded variation / of the workload in a 
G/G/l/oo queue, with respect to a parameter influencing the distribu- 
tion of the input process. For this, we use an idea of Konstantopoulos 
and Zazanis [15] based on the Palm inversion formula, however avoiding 
a limiting argument by performing the level-crossing analysis thereof 
globally, via Fubini's theorem. This method of proof allows to treat 
the case where the workload distribution has a mass at discontinuities 
of / and where the formula of [15] has to be modified. The case where 
the parameter is the speed of service or/and the time scale factor of 
the input process is also treated using the same approach. 

1 Introduction. 

Consider a stationary G/G/l/oo queue in which customers arrive according 
to a stationary process {T n }„ eZ . The customer n asks for a service time 
a n (9), where 9 is a real parameter in the compact interval O and {a n (0)} ne ^ 
is an i.i.d sequence. Let {r n } ne2 denote the inter-arrival times process sat- 
isfying r n = T n+ \ — T n . Assume that the queue is stationary and let Wg(t) 
be the remaining work in the system at time t — see Figure 1 — given by 
Lindley's equation 
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Figure 1: workload of a G/G/l queue. 



W e (t) = (w e (T n -) + a n (6) - (t - T n )) , t e [T n ,T n+1 ), (1) 



with the notation x + = 1 
functional J{6) defined as 



max(x,0). Given a real function /, consider the 



We want to estimate, if it exists, the derivative of J with respect to 9. 
To this end, we use Infinitesimal Perturbation Analysis (IPA), a method 
first introduced by Ho and Cao [13] and further developed by Cao [6], Suri 
and Zazanis [19] and recently Konstantopoulos and Zazanis [15]. Glasser- 
man [8] and Ho and Cao [14] summarize and review most previous results 
on IPA. Alternative methods have been used to estimate derivatives, namely 
Smooth Perturbation Analysis (SPA, see Suri and Zazanis [20], Gong and 
Ho [12], Glasserman and Gong [9], Fu and Hu [7]), Likelihood Ratio Method 
(LRM, see e.g. Reiman and Weiss [17] or Glynn [10]) and Rare Perturbation 
Analysis (RPA, see Bremaud and Vazquez- Abad [5] and Bremaud [2]). 

In this article, we aim to prove that, under appropriate conditions 



and we give a formula replacing (2) when / is not differentiable but is of 
bounded variation. This formula was obtained by Konstantopoulos and 
Zazanis [15] under stronger assumptions on the service times distributions. 
However, due to the difficulty of passing to the limit in their approximation 
procedure, their formula does not give any insight on the equality of the left- 
hand and right-hand derivatives ; this information is crucial for practical use 
of the derivative estimator. Our method of proof avoids the passage to the 



Jim I [W(W e+h (0)) - E/(W,(0))" 

= mUmUf(W e+h (0))-f(We(0)j\ =M^f(W e (0)) 



(2) 
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limit and therefore allows for better control of the computations. Moreover, 
it can be extended in many ways to handle different situations. 

The article is organized as follow: in Section 2, we give a construction of 
the G/G/l queue and we derive some basic properties. The main result of 
the article is given in Section 3 and the same method is applied to second- 
order derivatives in Section 4; Section 5 shows how our method can be 
extended to other parameters, respectively the speed of the server and the 
rate of arrival in the system. Section 6 discusses the implementation of 
the estimates and a short review of Palm probabilities can be found in the 
appendix. 

2 Construction of the G/G/l queue. 

In a formula like (2), the probability space does not depend on 9. To ob- 
tain this independence, we use the inversion representation (see Suri [18]) to 
generate service times: let {(„}„ 62 be a sequence of random variables uni- 
formly distributed on [0, 1]. Let F(-, 9) be the common distribution function 
of service times; we can define its inverse function 

G(£, 9) = sup(x > : F{x,0)<Q- 

Then a n {9) = G(£ n ,#) is distributed according to F(-,9). This means 
that, if we choose as basic stationary random sequences {r n } neZ and {£n} ne z, 
we define the queue on a probability space independent from 9. We note A 
the intensity of the input process and P° the associated Palm probability — 
see Appendix for notations and details. In order to apply IPA, the following 
assumption on service times is needed: 

Assumption Al The distribution of service times verifies the following 
conditions: 

(i) 9 i y G(£,9) is differ entiable and Lipschitz, that is 

|G(£A)-G(£,0 2 )|<tf ff (O|0i-02|, Ve 1 ,9 2 e@; 

(m) AIE £Tq < 1, with the notation a* = f sup eg @ a n {9) = sup^Q G(£ n , 9). 

Condition Al-(i) ensures that we have enough smoothness with respect 
to 9 in the distribution of the service times. However, in a number of cases, £ n 
will not be directly known, in particular when observing a real experiment; 
this difficulty can be overcome with the following classical proposition ( 
Suri [18]; for this formulation see Glasserman [8]): 
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Figure 2: the domination property. 



Proposition Suppose that (i) F(-,0) has a density d x F(-, 9) which is strictly 
positive on an open interval Ig and zero elsewhere; and (ii) F is continu- 
ously differentiable on Ig x O. Then 



In the above formula, the prime denotes the derivative with respect to 
9. A case of particular interest is when 9 is a scale parameter of the service 
times, that is when a(9) = 9n for some random variable r\. Then we have 
directly 



a\9) = V = 




In particular, we do not need to know the real distribution of service 
times unless we actually want to simulate them. Note that Al-(i) is similar 
to assumption (i) of Section 1 in Konstantopoulos and Zazanis [15]; it is 
the classical assumption on smoothed distributions needed for IPA. 

Using Assumption Al-(ii) , we derive a bound on the size of the busy 
periods of the system for all possible values of 9. We shall note that we don't 
know a priori whether cr* is P -a.s. finite or not; however, this condition 
is weaker than assumption (ii) and (Hi) of [15]. With that in mind, let 
{Rl}kez be the regeneration times at which the arriving customers of the He- 
system find the queue empty — the *-system is the queue with service times 
{cr*} ne2 , whereas the ^-system uses service times {o~ n (9)} ne ^. We can build 
the ^-system from the busy period process {R* k } k ei but with the service 
times given by {cr n (9)} neZ , so that the following domination property holds 
for the respective stationary workload of the queues — see Figure 2: 



With the above construction, we get {R^}kex f= {Rk(9)}kezi where 
{i?fc(6>)} fesZ — or simply {Rk}keT — denotes the beginning of busy period pro- 



AO) = - 



d e F(a(9),9) 
d x F(a(9),9)' 



W e (t) < W*(t), Vflee, VteE. 



(3) 
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cess for the ^-system. Moreover, we have the boundary property 

R*_(t) < R-(9)(t) < t < R+(6){t) < R* + (t). (4) 

3 An IPA estimator for general non-decreasing 
functions. 

In this section, we show that IPA applies with any non-decreasing cadldg 
function /. But since / is not required to be continuous, we cannot apply 
(2) as such. First of all, we need to introduce an assumption similar to 
assumptions Al, A2 and A3' of Konstantopoulos and Zazanis [15]: 

Assumption A2 The following inequalities hold: 
(i) E°[i^ )] 4 < oo; 
(it) EV([^,i?l))] 4 <oo; 
(Hi) E [/(VF*(0))] 2 < oo. 

Theorem 1 Let (if be the measure on IR associated with f. Assume Al 
and A2 hold. Then J admits a right derivative with respect to 8 given by 



J' r (9) = AEX(O) f(W e (0)) - /(Wff(Ti-)) 

" Hw>(o)<o}[vf({W e (0)}) - Hf({Wo(Ti—)}) 
and its left derivative is 



(5) 



J[(9) = AE°W^(0) 



f(W e (0)) - /(Wj(Ti-)) 



- l{^(o)>o } [l*f({We(0)}) ~ Hf({We(Ti-)}) 



(6) 



Example 2 With f(w) = l^ w>x y, Theorem 1 yields 



^P(W 9 (0)>x) 



- 1 



{WI(0)<0} 



&{W e (0)=x} ~ 1 {W e (Ti-)=x} 



de 



l -P{W e (0)>x) = XE°W(,(p) 



^(W$(Ti—),W$(0)] ( x ) 



- 1 



{WJ(0)>0} 



^{Wg(0)=x} - 1 {W e (Ti-)=x} 
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Theorem 1 shows that J(9) admits right and left derivatives even when 
/ is not continuous. But in a number of cases, we can get the equality of 
these two derivatives: 

Corollary 3 Assume Al and A2 hold. If f is continuous or ifWg(0) and 
We(T\—) admit densities with respect to P° then J (9) is differentiable and 

J'(9) = AEX(0)L/W0)) - f(We(Ti—))]. (7) 

Proof If / is continuous, then w i-> Hf({w}) = 0. If We(0) admits a P°- 
density, say j°(w), we can use the fact that ^/({-}) = almost everywhere 
for the Lebesgue measure: 

l EOl W(o)<o}M{^(0)})| < EV/({W*(0)}) 

= / fJ-f({w})-/°(w)dw = 0. 
Jo 

In either case, the result is proved. ■ 

Remark In the case where / admits a derivative /', we can use the inversion 
formula (22) of Appendix and write (7) as 

J'{9) = AE°[ ( Tl W' e {t)f(W e (t))dt\ = E[WJ(0)/'(W 9 (0))], 
Jo 

thus obtaining the expected IPA estimate (2). In this computation, we used 
the fact that Wg(t) is constant between arrivals during busy periods, and 
zero during idle periods. A comparison between the two estimates is made 
in Section 6. 

Before starting the proof of the theorem, let us mention that our deriva- 
tion is different from Konstantopoulos and Zazanis [15] in two respects: first 
we do not require an approximation procedure and we treat directly a non 
decreasing function /. This is made possible by the simple crucial observa- 
tion that 

f(y) ~ f( x ) = / Vf{ dz ) for a11 x <V, 

which allows us to have a better view of the residual terms in the level 
crossing analysis that follows. The result can be applied to any function of 
bounded variation if assumption A2 is verified by both the increasing and 
decreasing parts of the function. Secondly, we do not need switch back and 
forth between the Palm probabilities with respect to the arrival process and 
with respect to the regeneration points as in [15]. However, we retain the 
fundamental idea of [15] by starting with its expression in terms of the Palm 
probability P°. 
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Proof of Theorem 1 Assume that /(0) = 0, so that / is non-negative. 
The Palm inversion formula (22) gives 



E/(W e (0)) = 



AIE° 
AIE° 



f(W e (t)) dt 



Ti 



IRj 



^-{W e (t)>x} Vf{dx) dt 



= AIE° I f l {Wg(t)>x} dtfi f (dx) 

J IR.4- J 



and therefore 
1 



h 



E[/(W e+/l (0)) - f(W (O))] 



h 



° / / [ 1 {W r 9+ h(t)>x} - 1 {W fl (t)>x}]rf*M/(^)- 
^ IR.4- ^ 



In order to simplify the notations, let: 

def 



<f(x,t) = t{W e+h (t)>x} ~ ^{Wg{t)>x} 

§(0,h) = ( [ Tl <p(x,t)dtfif(dx). 
Jm+ Jo 

The first step of our proof is to compute lim^o h)/h. We will 
have to integrate a function taking its values in { — 1,0, 1} with respect to 
dtfif(dx). Define also for any t G [0,Ti): 

AW e , h = W e+h (t)-We{t). 

Assume first that h > 0. As shown in Figure 3, we must consider different 
cases depending on the relative position of Wq(0) and We + h(0). We have to 
add cases 3 and 3', where Wg(0) = 0, preventing us to guess their relative 
positions. In fact, all the terms of the formula can be found in the first two 
cases and we will leave the other ones to the reader's attention. 

Case 1: for h small enough, Wg + /j(0) > We(0) and ip = 1. The way to 
compute h) can be best understood with the help of Figure 4. $ is 
equal to the area with a dashed border plus the dotted triangle on the left, 
minus the right one. Here the borders included in the areas are in bold; 
since all functions are cddldg, these borders are the top and right ones. 



fiWem-fiWein-)) 
1 



h 



+ 



AW , h 

fif((W e (0),We(Q) + y])dy 

AW e , h 

A i / ((^(T 1 -),W e (T 1 -)+y])dy. (8) 
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T n T O Ti 

Case 1: W'(0) > and W(Ti-) > Case 2: W'(0) < and W(Ti-) > 




T T-y T n 

Case 1': W'(0) > and W(Ti-) = Case 2': W(0) < and W(Ti-) = 
Figure 3: Four different cases for the computation of <I>. 
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Positive correction 



Main area 




Negative 
Correction 



T o n 

Figure 4: computation of <I> in case 1. 



The first term converges to [f(W g (0)) - f{W 6 {Ti-))]W' e {Q). Moreover, 

M(W e (0), W e (0) + y]) = Hf((W (O), W (O) + y)) + fi f ({W e (0) + y}) 

and since fif({We(0) + y}) = dy-a.e., the second term of r.h.s. of equation 
(8) reads 

1 r AW g , h 

■ Hf((W e (0),We(p)+y))dy, 



h jo 

which is less or equal than 

(W2(0)+o(l)) M /((W 9 (0),W e+h (0))). 

Since Wg(0) is continuous in the neighborhood of 9, this goes to zero 
with h. The third term converges to for the same reasons. So we have in 
this case: 

£o + h) = M W °(°» ~ fiWe{Ti-))]W'M- 

Case 2: here W e+h (Q) < W e (Q) and if = -1. Due to the order of W 0+h (O) 
and Wg(0), we find a formula different from equation (8) — see Figure 5: 



-$(9,h) = -{ f(W e (,0))-f(We(Ti-)) 



-AW, 



e,h 



h 



I r-AW e , h 

-j o tif((W e (0)-y,We(0)])dy 



+ hi 



il/((W 9 (Ti-)-y,W 9 (ri-)])dj/}. (9) 
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Negative 
Correct 




Main area 



Positive correction 



T T\ 
Figure 5: computation of <I> in case 2. 



The first term is the same as in case 1, but the second is equal to 
i r-AWe. h 

- J o »f((W e (0) - y, W e (Q))) dy - »f({W g (0)})- 



h 



and its limit is fj,f({We(0)})Wg(0). The last term of $(0,h)/h is computed 
in a similar way. Finally: 



lim T <f>(6,h) 

h^0+ h 



f{We(0)) — f{Wg(Ti—)) 

-» f ({w e m) + »A{w e {Ti-)})\wt{o)- 



We can summarize the above cases in the following formula: 

n— ¥i)+ ft L 

- 1 W )<0}MW(0)}) - A*/(W(T!-)})] 



The next step is to find a bound for <&(#, h)/h which has a finite mean 
with respect to P°. The formulas for each case give: 



+ \f(W 9+h (0))-f(Wg(0))\ 



h 

h 



+ \f{W e+h {T 1 -))-f{W e {T 1 -))\ 
< 3f(W*(0))KW(0). 



AWg, h 



h 
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The last inequality takes advantage of the fact that / is non-decreasing and 
of the domination property (3). K^(t) is a Lipschitz coefficient for W(t) 
w.r.t. 9. Finally, 

^(9,h)\<3f(W*(0))K^(0). 

The latter expression is independent from h. Moreover, it has a finite 
mean under P°: from Cauchy- Schwartz inequality, 

E°[/(w*(o))i^(o)] < ydEV(^*(o))]ViE [i^(o)] 2 - 

The first mean is finite from assumption A2-(ra) . To prove that the 
second one is also finite, we must first give an expression of K^(0): 



W e+h (Q) - Wg(0) 



h 



; | W e+/t (T_i) - W e (r_i) a (9 + h)- a (9) 



< E 



h 

\a n {9 + h)-a n {9) 



■Tie's. 



h 



l[R*_(T ),0)( T n) 



< E K<J ^n)^-[R*_ (0),R* + (0))( T n) 

= Kf{0). 

The first inequality comes from equation (1) and inequality \a + — b + \ < 
\a—b\ \ then we use the boundary property (4) and last the Lipschitz property 
Al-(i) . To prove that IE^if^O)] 2 is finite, we can use the inequality 
(rri + ■ ■ ■ + x n ) p < n p_1 (xf + ■■■ + %%) and 



E °[E K<T (^n)^-[R*_(0),R*_(0))(T n ) 

E [^A([ J RS,i?D)[^ <T (Cn)] 2 l[^(o),ii;(o))(T„ 



< 

< E [A([ J RS,i?D)] 2 [^(eo)] 2 



which is finite from A2-(i) and A2-(m) . Here, the second inequality uses 
Lemma 9. 

Summing up our results, we can apply the Dominated Convergence The- 
orem: 

J' r .(9) d = f lim nf(We +h (0))-f(W e (Q))} 

= lim XE°T$(6,h) 
h^0+ h 



1 



AE U lim T $(6,h) 
h^0+ h 



11 



A W e (t) 
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T 



Figure 6: workload of the D/D/l queue. 



This gives equation (5). The case of h < is handled in the same way 
and gives equation (6) — loosely speaking, the above cases used the sign of 
We + h(0) — Wg(0); this sign is inverted if h < 0. This concludes the proof of 



Remark Assumption A2 ensures that WP[f(W*(0))K^(0)} < oo. If we 
know that / is bounded, for example, the only assumptions we need are 



This reduced set of assumptions can for instance be used in Example 2. 

It is important to point out that Corollary 3 cannot always be applied. 
We show such a case in next example : 

Example 4 Consider a D/D/l queue, that is with deterministic inter- 
arrival time r and service time 6 < r. In order to have a stationary queue, 
Tq must be uniformly spread in [— r, 0]. As we can see in Figure 6, we have 



the theorem. 



(i) E°[i^(£o)] 2 < oo; 
(m) IEV([^,#i))] 2 <°o. 



W(T n ) = 6, W(T n -) = 0, W' e {0) = 1 P°-a.s. 



For x > 0, take f(w) = t{ w > x y as in Example 2. Then if 9 < x, J(9) = 0, 



else 




Finally J{6) = P(W e (0) > x) = (^) , which is not differentiable at 



point 6 = x. Besides, 



J' r (d) = AIE°[1{ 6) > :E } - 1{ >x}] 
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1 

~^{0>x} 



T 

j/(0) = AIE [1{ 6 )> X } - l{ >a;} + ^{0=x} - ti{6=x}} 
= \^{6>x} 

4 Second order derivative. 

The method used in Section 3 can be used for higher-order derivatives. We 
need assumptions on the properties of our system and some new moment 
conditions: 

Assumption A3 G and f verify the following: 

(i) 6 h-> G(£,0) is twice differentiable and there exists a function £ i-> 

such that 

|G(£, + 2/i) - 2G(£, + /i) + G(£, 0)| < ^^(0; 

(ii) w i->- /(u/) is non- decreasing and differentiable. 
Assumption A4 The following inequalities hold: 

(i) E°[tf"(6>)] 8 < oo; 

(ii) E°[^'(e )] 4 <oo; 

(???) E°[A([^,«1))] 8 < oo; 

(it;) E°[/(^*(0))] 2 <oo; 

(v) E°[sup e f(^(0))] 2 <oo; 

(vi) WP[sup e f'(W e {T 1 -))] 2 <oo. 

The main result of this section is: 

Theorem 5 Assume Al, A3 and A4 /ioW; then J admits a right second 
derivative with respect to 8 given by 

J' r '(9) = AE°[<(0)[/(^(0))-/(^(T!-))" 

+ [W\O)} 2 [f'(W (O))-f'(Wg(T 1 -)) 



- 1{W'(0)<0)MW(0)}) - M/'({^(Ti-)})] 



,(10) 
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and its left second derivative is 



AIE 



W£(0)[f(W e (0)) - /(Wei^-)) 
+ [W'(O)] 2 [f , (W e (O))-f(W (T 1 -)) 
- *{w>(o)>o}\Mf>({Wo(0)}) ~ »f>({Wo(Ti-)})] 



.(11) 



Corollary 6 Assume Al, A3 and A4 hold; if f is continuous or ifWe(ti) 
and We(T\— ) admit densities w.r.t. P° then J($) is differ entiable twice and 



J" (6) = AE° 



W^(0)[f(W e (0)) - fiWeiT,-)) 
+ [W'(0)} 2 \f'(Wg(0))-f f (Wg(T 1 -)) 



Proof of Theorem 5 As this proof is very similar to that of Theorem 1, 
we will omit the parts of it which are not new. We want to compute the 
limit as h — > of 



1 



IE 



f(W e+2h (0)) - 2f(W e+h (0)) + f(W e (0)) 



A 



E°$ 2 (0,fc), 



with 



*2(e,h) 



IR+ J 



\ t {W e +2h{t)>x} ~ 1 {W e+h (t)>x}} 
[^{w e+h {t)>x} ~ ^{w g (t)>x}\ dtnf{dx). 



We will once more distinguish two important cases among all possible 
ones, depending on the sign of Wq(0). Suppose first that h > 0. 

Case 1: W' e (G) > 0; for h small enough, Wg(0) < W e+h (0) < W e+2h (0)- 
see Figure 7. We have here to subtract the areas of two bands which are of 
the same sort as in Theorem 1: 



Q 2 (B,h) = AW 0+h , h [f(W e+h (O))- fiWe+hiT,-)) 
- AW e , h [f(W e (0)) - fiWeiT,-)) 
+ A e>h {0) - Ag^-) 



where 



A e , h {t) 



L 



&w e+h , h 

» f ((W e+h (t),We +h (t)+y})dy 



Hf((We(t),W e (t) + y})dy. 
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t o n T o n 

Figure 7: computation of $2 in cases 1 and 2 

The main term is equal to 

AW e+h , h [f(W e+h (0)) - /(We+hin-)) - f(W e (0)) + /(w 9 (Ti-)) 

+ A 2 W^[/(W e (0)) - /(W 9 (Ti-)) 
Moreover, 



A?,h(0) 



f(W e+h (0)+y)-f(W e+h (0)) 
- f(W 9 (0) + y) + f(W e (0))} dy + o(h 2 ) 

= / hW^0)fi f/ ((Wg(0),W e (0) + y})dy + o(h 2 ) 
Jo 

As in Theorem 1-case 1, lim^o ^e,h{^)/h 2 = 0; the limit is the same for 
Ae,h{Ti~). Consequently, 

^ 2 (8, h) = [W' e m 2 [f'{W e (0)) - f'(We{T\—)) 
+WS(0)[f(W e (0)) - f{W e {T 1 -))_ . 
Case 2: W' (G) < 0; for h small enough, Wg(0) > W e+h (0) > W e+2 h(0) and 

*2(0,h) = -l-{-AW e+M [/(W m (0))-/(W 9+h (Ti-))" 



- AWe, h [f(W e (0)) - f(W e (T x -)) 
-5tf )ft (0) + B eih (Ti-)} 
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where 



B 9 , h (t) 



'nf((Wo+ h (t)-y,W e+h (t)])dy 
fif((W e (t)-y,W g (t)])dy. 



While the main part has the same limit as in case 1, we have 
f-AW e , h 

Bg, h (0) = J hW^0)fi f >((Wg(0)-y,W e (0)])dy + o(h 2 ) 
= -h 2 [W^0)} 2 H i{W 6 (Q)}) + o(h 2 ). 
Finally, in case 2, 



\im + ^ 2 (e,h) = \wm?[f'{We{0))-f'(We{Ti-)) 
+ Wg(0)[f(Wo(0))-f(Wo(T 1 -))\ 

Besides, 
1 



h 2 



$ 2 {0,h) < 3 sup/ / (W e (0))+snp/ , (V^(Ti-)) K^{0) 
1 e e 11 

+ f{W*{Q))Kf{Q), 
where ^(0) is the same as in Theorem 1 and 

Kf(Q) d = f £ K°\Z n )t [R1{0) , R * +m (T n ). 

As in theorem 1, we use Lemma 9, Cauchy-Schwartz inequality and 
assumption A4 to prove that |<3?2(#, ^)/^ 2 | has a finite mean under P°. 
Using the Dominated Convergence Theorem, we find expressions (10) and 
(11) for the second derivatives of J. ■ 



5 Other parameters of the queue. 

Let us consider a setting slightly different from the original one: we still deal 
with a G/G/l queue, but now working at speed v. Lindley's equation for 
the workload of the queue reads: 

W v (t) = (w v {T n -)+a n -v(t-T n )) + , te[T n ,T n+1 ). 

We address the same problem as in Section 3 in this new setting. Our 
method can apply in this case in the same way as for variable service times; 
we will try to keep the notations as close as possible to those of Section 2 
to point out the similitudes, replacing 6 with v when necessary. 
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Figure 8: the domination property for the speed 

Remark As an anonymous reviewer pointed out, if we define W v {t) = 
vW v (t) we have the relation: 

W u (t) = (w u {T n -) + ^-(t- T n )) + , t e [T n ,T n+1 ). 

This means that the queue with workload W u fits in the framework of Sec- 
tions 2 and 3. Nevertheless, what we want to estimate is (d/dv)Mf(vW v ({))), 
which does not follow directly from Theorem 1. The extra computations 
needed would cancel the gain of using Theorem 1. Note also that this result 
will be useful in the second part of this section to deal with parameters of 
the arrival process. 

Assume that v > v* > 0; then as in Section 2, we can construct all the 
queues for different values of v so that for all v > v* and t € K, we have 
the relation (see Figure 8) 

W v {t)<W v *{t) (12) 

R*_(t) < R-(v)(t) < t < R+(v)(t) < R* + (t), (13) 
The assumption on moments we need is much like A2: 

Assumption A5 The following moments are finite: 

(i) E°[t ] 4 < oo; 

(ii) E [A([^,«!))] 4 <oo; 
(tit) E°[/(W^(0))] 2 <oo. 

The first real difference with the results of Section 3 is that the expres- 
sions for the derivative use a primitive of /, whereas only / appeared in 
Theorem 1. 



17 



Theorem 7 Let F be a primitive of f; if A5 holds, then J has a right-hand 
derivative equal to: 

j'M) = A E o| l/W / (0) [ /(w - ;/(0)) _ /( ^ (ri _ )) - 

+ F(W u (0)) - FiW^-)) 

- [W„(0) - W v (Ti—)]f(W„(Ti—))^ (14) 
and its left-hand derivative is 

j[{u) = ^m^w' v {Q)[f{w v m- fiw^-)) 

+ F(W„(0)) - F(W„(Ti-)) 

— [Wv(0) — W u (Ti—)]f(W 1/ (Ti—)) 

+ vWU0)M{W v {0)}) ~ M/({W,(T 1 -)})] 

- [W„(0) - W u (Ti—)]fif({W u (Ti—)}) 



If f is continuous or if both W u (0) and W V (T\—) admit densities w.r.t. 
P° , then J is differentiate and its derivative is equal to J' r . 

Remark The expressions in Theorem 7 seem really complicated when com- 
pared to those obtained in Theorem 1; in fact, in the case where / is differ- 
entiable, the inversion formula applied to (14) gives the classic IPA formula 

j» = w;(o)/(^(o)). 

The complexity of (14) comes from the fact that W v (t) is not constant on 
[To, Ti). 

Proof of Theorem 7 We once more proceed as in the proof of Theo- 
rem 1 — more details can be found in [4] . Define 

$(!/, h) = ( f [t {Wu+hit)>x} - t{ Wv {t)>x}\ dtfif(dx) 
J IR-i- J 



and remark that 



lnf(W u+h (0))-f(W u (0))] = ^E°*{v,h). 

We will consider only right-hand derivatives; left-hand derivatives are 
obtained with the same method. Figure 9 shows how can be computed: 
the main area is equal to the area of the trapezium on the right. As W v is 
linear in v, we have 

AW^iTi-) - AW„, h (0) = hT{, 
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where 



Tl def 
1 = mm 



r^(0) 



W„(0) - W^(Ti-) 



The area of the trapezium of Figure 9 is equal to 



.A = 



+ 



/(W„(0)) - /(W„(Ti-)) 

1/(1/ + /i) 



/1 



/i rAw„ ft (o) 



/(W„(0)) - /(W^Tx-)) 



1 r 

+ - 



F(W„(0)) - F(W V (T X -)) 
W v (0) - W U {T X 



The additional terms read: 



L 



M/((W I/ (0),W 1/ (0) + (i/ + %])d J/ 
- / " ^/((^m-), W^Ti-) + (y + %]) dy. 

JO 

As we have shown in the proof of Theorem 1, this kind of expression is 
an o(h) and 



lim ${v,h) 



+ 



f(W v (0)) - /(W„(Tx-)) 
F{W U {Q)) ~ F{Wu{Ti-)) 
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Moreover, as in Theorem 1, we have 

l*(",h)\ < \W™ (0) + 2r ]/(^(0)), 

where K^(0) is a Lipschitz coefficient for W„(0) w.r.t. is, which can be 
expressed as in Theorem 1 as 

K^{0) = T n^[R*_ (0),R* (0))(^n)- 

One can easily check that assumption A5 suffices to prove that \&/h\ is 
bounded by an integrable variable. Consequently, we can apply the Domi- 
nated Convergence Theorem and find the expected result. ■ 

The method used so far does not apply to the case where the parameter 
of interest is a parameter of the inter-arrival times; in this case, the Palm 
measure associated to the arrival process depends on the parameter and the 
method fails. We show how a change of time scale can be used in some cases. 
We consider a G/G/l queue with inter-arrival times {T n (a)} neZ: , a > a* > 
and we will restrict our attention to the following case: 

Assumption A6 a is a scale parameter for T n (a), that is T n (a) = arj n . 

Lindley's equation takes the form 

W a {t) = (w a {T n (a)-)+cj n -(t-T n (a))) + , t€ [T n (a),T n+1 (a)) (15) 

Now define a G/G/l queue with speed a which inter-arrival times, service 
times and arrival process are given by: 

def T n (a) _ 
a 

def 

0~n = On 

^ def T n (a) 
a 

These processes are stationary with respect to the measurable flow Ot = 
6 a t and the queue they define is stable whenever the original one is; this 
queue will be referred to as the "auxiliary system" . Throughout this section, 
we will use the same notations as for the main system, but with a tilde. 
Lindley's equation for the auxiliary system reads: 

W a (t) = (Waif n -) + a n - ait - f n )) + , t G [f n ,f n+1 ). (16) 
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Figure 10: Change of time scale for a = 2. 



Comparing equations (15) and (16) and noting that the process W a (at) 
is stationary with respect to the flow 9 t , uniqueness in Loynes' Stability 
Theorem — see Baccelli and Bremaud [1] — yields 

W a {t) = W a (t/a). 

The effect of the change of time scale can be seen on Figure 10. Moreover, 

A = El((0,l]) 

= EA((0,o]) = a\(a) 
K(0) = <(0). 

In the computation of A, we use the fact that the auxiliary system is 
defined on the same probability space than the main one. It has its own 
Palm measure associated to {T n }„ eZ , say P . The way to switch between 

probability measures P„ and P will be shown in the proof of Theorem 8. 
Before proceeding, we need a set of A5-like conditions: 

Assumption A7 The following conditions hold: 
(i) E°[to] 4 <oo; 
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{in) E°,[/(W^(0))] 2 <oo. 

Using this model, we find the following result: 

Theorem 8 Assume A6 and A 7 hold; then 
A, 



J' r {a) 



a 



< «<(0) f{W a m-f{W a {T 1 -)) 



+ [F(W a (0)) - F(W a (Ti-)) 

- [w Q (0) - Wa(ri-)]/(w a (ri-)) 



(17) 



J?(a) 



A, 



+ [F(W a (0)) - F(Wa(:ri-)) 

- [w Q (o) - w a (ri-)]/(w a (ri-)) 

-aW' a {Q)[^{{W a {Q)})-^{{W a {Ti-)}) 
+ [W Q (0) - ^(^-^({W^-)})}. 



(18) 



If f is continuous or if W a (0) and W a (Ti(a)—) admit densities with 
respect to P„ then J is differentiable w.r.t. a and its derivative is equal to 



Proof We have 



J(a) = E/(W a (0)) = E/(W Q (0)) 



where W Q (0) is the workload of the auxiliary queue with speed a. We aim 
to apply Theorem 7 to this queue and then adapt the result to the main 
queue. The three conditions of A5 correspond to the three ones of A7: for 
condition A5-(i) , note that 



IE [f ] 



A nez 

1 „^rr„(a)n4 



a\(a 
1 

a 



a 



{T„(a)e(0,a]} 



4 K [r ] 4 < oo 



and for A5-(u) 



E°[A([i?s,i?D)] 4 = iiE^^d^^)^;^)))] 4 !^^ 



1]} 
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= -^-TlEEW^-( T «)^;(^)))] 4 l { T„(a* 
aA \ a ) ne z 

Finally, for A5-(m) , 

E°[/fc(o))] 2 = K4f(w a *(o))] 2 < oo. 

So we apply Theorem 7 and find for the right-hand derivative: 



)e(o, Q *]} 



+ [F(W a (0)) - F(Wa(Ti-)) 
- [W a (0) - V^(f 1 -)]/(VK a (f 1 -)) 
This gives Equation (17); the left-hand derivative is derived similarly. 



6 Implementation of the method. 

The formulas given in preceding sections will be interesting only if they 
provide estimates which are (i) easy to compute and (n) strongly consistent, 
which means that they converge a.s. to their expected values. In this section 
we show how the estimate given by Corollary 3 can be used in simulation 
when the system is ergodic. In this case, ergodic theorem (26) applied to 
equation (7) reads: 



A 



n— 1 



J'{0) = \im-J2K(Tk)[f(Wg(T k ))-f(W e (T k+1 -))} 



k=0 
n-l 



= }^-Y, W 'e( T k)[f{W e {T k ))-f(W e {T k -))). (19) 



k=0 



The different ingredients of this formula are easy to evaluate once the 
simulation of the queue is set up: We(T k ) and We{T k —) are known when 
customer k joins the queue; to get W' e (T k ), we use equation (1), keeping in 
mind that both W(t) and W'(t) are cadlag processes and find: 



W' e {T k 



<J k (0) if customer k finds the system empty 

W'^T^) + a' k {9) else. 

As shown in Section 2, a' k can most of the time be expressed as a function 
of a k and 6, say a' k = D(a k ,6). So if we define w k = Wg(T k —) and d k = 
W' e {T k ), we have 

w k = (w k -i + cr fc _i - T fc _i) + 
d k = d k ^it{w k > 0} + D(a k ,8), 
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and equation (19) shows that 

A n ~ ^ 

<t>n = ~ E d k[f( w k + O-fc) - /(Wfc)] 
n fc=0 

is a strongly consistent estimate of J' (9). Since our Palm estimate does 
not require differentiability for /, one will want to check whether it is as 
accurate as the classic IPA estimate: if the system is ergodic, the ergodic 
theorem (25) of the appendix applied to equation (2) gives 

J'{9) = lim - fw' e (s)f{W e {s))ds 

t-*oo t Jo 

1 n ~ 1 rT k+ i 

n k=0 JIk 
-. n— 1 

= ^7 F Y. W 'e( T k)[f(W 6 {Tk))- f{W e {T k+1 -))l (20) 

where all the limits are valid P°-a.s. or P-a.s. indifferently. In the third 
equality, we used the fact that W' e {t) is zero during idle periods. Compar- 
ing equations (19) and (20), we see that the estimates based on the same 
amount of data give very close expressions; in fact, they are even equal 
when A needs to be estimated. For comparisons between time-average and 
customer- average estimates, see for instance Glynn and Whitt [11]. The 
implementation of an estimate of the second derivative of J would be done 
exactly in the same way, except that the formulas involved are slightly more 
complicated. 



Appendix: a short introduction to Palm theory. 

In this appendix we give without proof some basic results on Palm theory; 
interested readers can refer to Baccelli and Bremaud [1] for a more complete 
presentation of the subject. The stationary framework is the following: 
given a probability space (SI, J 7 , P), let 9 t , t G IR be a measurable flow 
{n,T) i y (n,T), i.e.: 

• (t,co) i->- 9 t uJ is measurable w.r.t. £>(1R) (g> J 7 , 

• 0t is bijective for all t G IR, 

• 9to8 s = Ot+s for all t, s G IR. In particular, #o =identity and < T 1 = Q-t- 

Note that there is nothing common between the flow 9t and the parame- 
ter 9 of the queue; these are the traditional notations in sensitivity analysis 
and Palm theory. We assume that Po# t = P. Let {T„} ne2 and {C/ n } ne2 
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be two simple point process and let A and D be the associated counting 
measures, that is, for all borelian set C 6 IR, 

A(C) = ]T l c (T n ), D(C) = ]T l c (U n ) 

and assume that for each n £ 2, U n — T n = W n > 0. We take the convention 
To < < Ti and note: 

T_(t) = sup(T„ : T n < t), 
T+(t) = inf(T n : T n >t). 

A and D are viewed as arrival and departure processes and we note 
X{t) a queueing process associated with them. Let B(t) be a non decreasing 
cadlag — i.e. right continuous with left limits — real valued process and Z(t) a 
non- negative real- valued stochastic process. We assume that these processes 
are compatible with the flow 9 t , that is 

A(u,C + t) = A(9 t u,C) 
Z(uj,t) = Z(9tu,0). 

Similar equalities hold for D and X; if we define = E[A((0, 1])], then 
there exists a probability measure called the Palm probability of the sta- 
tionary process (A,6t,P) verifying the Swiss Army Formula (Bremaud [3]): 

\aK[[ Z(s)dB(s)] = 1 -n[ X(s-)Z(s)dB(s)} (21) 

The Swiss Army Formula is not the definition of the Palm measure, but 
we will see that it contains this definition and the classic formulas of Palm 
theory. We shall add that under P^, To = a.s. We derive now some useful 
formulas from (21). The first one is the inversion formula: Take U n = T n+ \ 
and B(s) = s; then X(t) = 1 and 

E[Z(0)] = A A IE^[ [ Tl Z(s)ds}. (22) 
Jo 

The second formula is Neveu's exchange formula (Neveu [16]): we take 
D as for the inversion formula and remark that if B = A, (21) reads 

XaK[Z(0)] = IjE[[ Z{s)dA{s)]. 
t J(o,t] 

This is Mecke's definition of Palm probability. Now, if B is a point process, 
we use the above equation and (21) to derive the exchange formula: 

[ Tl Z(s)dB(s)} = X B JE° B [Z(0)}. (23) 
Jo 

We will now prove a simple lemma which replaces Wald's identity for 
stationary systems: 
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Lemma 9 Let {R n } n ez be a stationary stochastic point process with asso- 
ciated measure B. The following holds: 



/ Z(s)dA(s)]=JE A [A([R ,R 1 ))Z(0)]. (24) 
J[Ro,Ri) J 



Proof If we note Y the random variable inside the expectation of the l.h.s. 
of equation (24), then 

Yo9 Ti = f Z{s)dA{s) = £ Z(T n )l [R _ {Ti) , R+{Ti)) (T n ). 

J[K-(li),H + (li)) neZ 

Since R±{Ti) = R±(0) if T; G [R-(0), R+(0)), 

Y YoO Ti = Y Z ( T «) IL [i?-(0), J R + (0))( T n)l[R_(0),R + (0))( T i) 

T t e[R-(0),R+(0)) ieZ-neZ. 

= A([R ,Ri))'£Z(T n )l [RotRl) (T n ). 

If we now apply Neveu's exchange formula (23) between and P%, we 
obtain: 

Xa^aY = X B ^% Y Yo9 Tx 
Tie[R-(o),R+(o)) 

= XbK[£ A([Ro,Ri))Z(T n )l [R(hRl) (T n ) 

= X A TE A [A([R ,R 1 ))Z(0)], 

which is exactly equality (24). ■ 

Formula (24) can be seen as an extension of Wald's identity that can be 
used for stationary sequences instead of i.i.d. variables and applies to any 
stationary process. It is not as convenient as Wald's identity is, but is valid 
in a wider setting. 

Remark Lemma 9 is also a corollary of the extended H = XG formula (6.2) 
of Bremaud [3] . 

Palm probabilities can also be given an interpretation which relates them 
to simulation. When (P, t ) is ergodic, the ergodic theorems for P and P° 
read: 

1 /■* 

MY] = lim - / Y o 9 s ds 
11 t^oo t Jo 

-. n— 1 

WP A [Y] = lim - YYo9 Tk 

k=0 
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which imply that: 



1 f* 

E[Z(0)] = lim - / Z{s)ds (25) 

t-KX> t JO 



KlZm = \™-J2Z(T k ). (26) 



k=0 



These equalities are valid P-a.s. and P^-a.s. This shows that E[Z(0)] 
is the time-average of the process Z(t), whether IE^[Z(0)] is its customer- 
average. 
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